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Abstract. In this paper we consider ensemble of random matrices X„ with 
independent identically distributed vectors {Xij,Xji)i^j of entries. Under 
assumption of finite fourth moment of matrix entries it is proved that empir- 
ical spectral distribution of eigenvalues converges in probability to a uniform 
distribution on the ellipse. The axis of the ellipse are determined by cor- 
relation between X\2 and X21. This result is called Elliptic Law. Limit 
distribution doesn't depend on distribution of matrix elements and the re- 
sult in this sence is universal. 
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1. Introduction 

Let us consider real random matrix X„(w) = {Xjj(u;)}™ J=1 and assume that 
the following conditions (CO) hold 

a) Pairs (-Xy, Xji),i ^ j are independent identically distributed (i.i.d.) random 
vectors; 

b) EX 12 = EX 21 = 0,EX% 2 = EJCfj = 1 and max(E |Xi 2 | 4 ,E |X 2 i| 4 ) < M 4 ; 

c) E(X 12 X 21 ) = p, \p\ < 1; 

d) The diagonal entries Xn are i.i.d. random variables, independent of off- 
diagonal entries, EXq = and EI^ < oo. 

Denote by Ai, X n the eigenvalues of the matrix n _1 ' 2 X n and define empirical 
spectral measure by 

p n (B) = -#{1 < i < n : A, G B}, Be B(C), 
n 

where B(C) is a Borel cr-algebra of C. 

We say that the sequence of random probability measures m n (-) converges 
weakly in probability to probability measure m(-) if for all continues and bounded 
functions / : C — > C and all e > 



lim 1 

n— >oa 



f(x)m n (dz) - / f(x)m(dz) 



C 



> e = 0. 



We denote weak convergence by symbol weak y _ 

A fundamental problem in the theory of random matrices is to determine the 
limiting distribution of p n as the size of the random matrix tends to infinity. 
The main result of this paper is the following 



Theorem 1.1. (Elliptic Law) Let X n satisfies condition (CO) and \p\ < 1. 

t I 

x,y € £, 



Then \i n weak y ^ % n probability, and \x has a density g: 



where 



7r(l-p 2 )' 

0, otherwise, 



£;= <„ 6K; _^ + _^_ 5 < 1 



Theorem 1.1 asserts that under assumption of finite fourth moment empirical 
distribution weakly converges in probability to uniform distribution on the el- 
lipse. The axis of the ellipse are determined by correlation between X± 2 and 
X 2 \. This result was called by Girko "Elliptic Law". Limit distribution doesn't 
depend on distribution of matrix elements and the result in this sense is uni- 
versal. 



Figure [T] illustates Elliptic law for p = 0.5 and Figure [2]- for p = —0.5. 
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Figure 1. Eigenvalues of matrix n. —1 / 2 X for n = 3000 and p = 
0.5. On the left, each entry is an iid Gaussian normal random 
variable. On the right, each entry is an iid Bernoulli random 
variable, taking the values +1 and —1 each with probability 1/2. 





Figure 2. Eigenvalues of matrix n~ 1//2 X for n = 3000 and p = 
—0.5. On the left, each entry is an iid Gaussian normal random 
variable. On the right, each entry is an iid Bernoulli random 
variable, taking the values +1 and —1 each with probability 1/2. 



In 1985 Girko proved elliptic law for rather general ensembles of random ma- 
trices under assumption that matrix elements have a density, see [7] and (8J. 
Girko used method of characteristic functions. Using U-transform he reduced 
problem to the problem for Hermitian matrices (n~ 1//2 X n — zI)*(ra~ 1 / 2 X n — zl) 
and established convergence of empirical spectral distribution of singular values 
of n -1 / 2 X n — zl to the limit which determines the elliptic law. 

Let elements of real asymmetric random matrix X have Gaussian distribution 
with zero mean and correlations 



EXfj = 1 and EJfyXy 



P, i / h \p\ < 1- 
The ensemble of such matrices can be specified by the probability measure 



F(dX) ~ exp 



n 



Tr(XX T - pX 



2(1 
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It was proved that p n > p, where p has a density from Theorem 



1.1 



sec 



14 



We will use this result to prove Theorem 1.1 in the general case 



Remark 1.2. This result can be generalized to an ensemble of Gaussian com- 
plex asymmetric matrices. In this case, the invariant measure is 



F(dX) ~ exp 



n 



Tr{XX T - 2RepX z ) 



1-M 2 

and ~K\Xij\ 2 = 1,M X^Xji = \p\e 2td for i ^ j. Then the limit measure has a 
uniform density inside an ellipse which is centered at zero and has semiaxes 
1 + |p| in the direction 9 and 1 — \p\ in the direction 9 + ir/2. 

For the discussion of elliptic law in Gaussian case see also [6], [IJ Chapter 18] 
and [10]. 

We repeat physical motivation of models of random matrices which satisfy con- 



dition (CO) from 14 : "The statistical properties of random asymmetric matri- 
ces may be important in the understanding of the behavior of certain dynamical 
systems far from equilibrium. One example is the dynamics of neural networks. 
A simple dynamic model of neural network consists of n continues "scalar" 
degrees of freedom(" neurons") obeying coupled nonlinear differential equations 
("circuit equations"). The coupling between the neurons is given by a synap- 
tic matrix X which, in general, is asymmetric and has a substantial degree of 
disorder. In this case, the eigenstates of the synaptic matrix play an important 
role in the dynamics particulary when the neuron nonlinearity is not big". 

It will be interesting to prove Theorem |1.1| only under assumption of finite 
second moment and prove sparse analogs. It is the direction of our further 
research. 

If p = we assume that all entries of X n are independent random variables and 
Circular law holds (see [2], [16], [9]): 

Theorem 1.3. (Circular law) Let X„ be a random matrix with independent 
identically distributed entries, E Xij = and E Xf- = 1 . Then p n weak y ^ i n 
probability, and p has uniform density on the unit circular. 

See Figure [3] for illustration of Circulaw law. 

If p = 1 then matrix X n is symmetric and its eigenvalues are real numbers. In 
this case the next theorem is known as a Wigner's semi-circular law (see [2]): 

Theorem 1.4. (Semi-circular law) Let X n be a symmetric random matrix 
with independent identically distributed entries for i > j, EX^ = ; EX^ = 1. 

Then p n weak y p % n probability, and p has a density g: 
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FIGURE 3. Eigenvalues of matrix n. —1 / 2 X for n = 3000 and p = 
0. On the left, each entry is an iid Gaussian normal random 
variable. On the right, each entry is an iid Bernoulli random 
variable, taking the values +1 and —1 each with probability 1/2. 



Throughout this paper we assume that all random variables are defined on 
common probability space (0, 3~, P) and we will write almost surely (a.s) in- 
stead of P-almost surely. By Tr(A) and rk(A) we mean trace and rank of 
the matrix A respectively. We denote singular values of matrix A by Si(A) 
and si(A) > 52(A) > ... > s n (A). For vector x = (x\,...,x n ) we introduce 

IMh := (Sr=i x i) 1 ^ 2 an d 1 1 a? 1 1 3 := (Yli=i l^il 3 ) 1 ^ 3 - We denote unit sphere and 
unit ball by S' 11 ^ 1 := {x : ||ic||2 = 1} and := {x : \\x\\2 < 1} respectively. 
For matrix A define spectral norm by ||A|| := sup IE .|| :2 .|| 2=1 ||Ax||2 and Hilbert- 

Schmidt norm by ||A||#s := (Tr(A*A)) 1 / 2 . By [n] we mean the set {1, ...,n}. 
We denote by B(T) - Borel c-algebra of T, where T = R or C. 



2. Proof of the main result 



Further we will need the definition of logarithmic potential (see [12]) and uni- 
form integrability of function with respect to the sequence of probability mea- 
sures. 

Definition 2.1. The logarithmic potential U m of measure m(-) is a function 
U m : C — > (—00, +00] defined for all z £ C by 



U m (z) = — / log \z — w\m(dw). 
Jc 

Definition 2.2. The function f : T — > R ; where T = C or T = R, is uni- 
formly integrable in probability with respect to the sequence of random measures 
{m n } n >i on (T,0(T)) if for all e > 0: 



lim lim P / \f{x)\m n (dx) > e \ = 0. 

t-*x>n->oo W|/| >t / 
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Let s 1 (n-V 2 X - zl) > s 2 (ra~ 1/2 X - zl) > ... > s^rT^X - zl) be singular 
values of n~ 1 / 2 X n — zl and 



, B) = > 1 : Si (n- 1/2 X - zl) E B}, Be B(I 

n 



empirical spectral measure of singular values. We will omit argument z in 
notation of measure v n (z,B) if it doesn't confuse. 

The convergence in the Theorem 1 1 . 1 1 will be proved via convergence of logarith- 
mic potential of fj, n to the logarithmic potential of /i. We can rewrite logarithmic 
potential of fj, n via the logarithmic moments of measure u n by 



2n 



log det 



log \z — w\fJL n (dw) 
X n - zl 



1 



n 



n 



X r , 



log 



det 
zl 



1 



r? 



X n - zl 



\ogxv n {dx). 



This allows us to consider Hermitian matrix (n 1 ^ 2 X n — zl)*(n 1 ^ 2 X n — zl) 
instead of asymmetric n _1 / 2 X. To prove Theorem 1.1 we need the following 

Lemma 2.3. Let (X„,)„>i be a sequence of n x n random matrices. Suppose 
that for a. a. z £ C there exists a probability measure v z on [0, oo) such that 

\ weak . j . ' i • i 

a) v n > v z as n — } oo in probability 

b) log is uniformly integrable in probability with respect to {f n }n>i- 
Then there exists a probability measure \i such that 

\ weak 
a) fJL n 



-> fi as n — y oo in probability 
b) for a. a. z G C 

UJz) = - 



log xv z {dx). 



Proof. See j3j Lemma 4.3] for the proof. 



□ 



Proof. (Proof of Theorem |1.1[ ) Our aim is to prove convergence of v n to u z , uni- 
form integrability of log(-) with respect to {vn}n>i and show that v z determines 
elliptic law. 



From Theorem 4.1 we can conclude uniform integrability of log(-). The proof 
of Theorem 14.11 is based on Theorem 13.11 and some additional results. 



In Theorem 



5.2 



it is proved that v n 



weak 



> v z in probability, where v z is some 



probability measure, which doesn't depend on distribution of elements of matrix 
X. 

If matrix X has Gaussian elements we redenote \x n by jl n . 



By Lemma 2.3 there exists probability measure p, such that /x n 



weak 



-> p, m 



probability and Ufi(z) = — J °° log xv z (dx). But in Gaussian case //„ weak y ^ i n 
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probability and U^z) = — \ogxv z (dx). We know that v x is the same for all 
matrices which satisfy condition (CO) and we have 

;>oo 

Ujx(z) = - \ogxv z (dx) = Ufj,{z). 
Jo 

From unicity of logarithmic potential we conclude that p, = p. □ 

3. Least singular value 

From properties of the largest and the smallest singular values 

si(A) = ||A|| = sup ||Ax||2, s n (A) = inf ||Ax||2- 

x:||x|| 2 =l x:||a;||2=l 

To prove uniform integrability of log(-) we need to estimate probability of the 
event {s n (A) < en" 1 / 2 , ||X|| < Ky^n}, where A = X — zY. We can assume that 
En —i/2 <- ^ n !/ 2 _ jf | z | > 2Ky/n then probability of the event is automatically 
zero. So we can consider the case when \z\ < 2Kn 1 l 2 . We have ||A|| < ||X|| + 
\z\ < 2>Kn 1 / 2 . In this section we prove theorem 

Theorem 3.1. Let A = X — zl, where X is n x n random matrix satisfying 
(CO). Let K > 1. Then for every e > one has 

P(s„(A) < en' 1/2 , ||A|| < $Ky/n) < C{p)e 1 ^ + Ci(p)n _1 / 8 , 
where C{p),C\{p) are some constants which can depend only on p,K and M4. 

Remark 3.2. Mark Rudelson and Roman Vershynin in and Roman Ver- 
shynin in \Fq found bounds for the least singular value of matrices with in- 
dependent entries and symmetric matrices respectively. In this section we will 
follow their ideas. 



3.1. The small ball probability via central limit theorem. We recall 
definition of Levy concentration function 

Definition 3.3. Levy concentration function of random variable Z with values 
from M. d is a function 

L(Z,e) = supP(||Z-t>|| 2 <e). 



The next statement gives the bound for Levy concentration function of sum of 
independent random variables in K. 

Statement 3.4. Let {a^ + 6j7/j}j>i be independent random variables, E£j = 
Era = 0, E£ 2 > I.Etj? > I, E&n~= p, max(E if, E nf) < M 4; aT% = O(l). 
We assume that r(2n) -1 / 2 < |a,,| < (5n)~ 1 / 2 , where 8,r are some constants. 
Then 

£ ( J2(ai& + btTH),e ) < Cs /2 + Ci 



(l_ p 2)l/2 (l- p 2)3/2 n l/2' 
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.2 _ w C 2 ^2 — tt? ^.2 



Proof. Set er^ = E£ 4 and a/ 2 = Er/,- . It is easy to see that 

n 

n 

= XT Kl^tf. + 2po-iicr i2 a7 1 6i + o-f 2 (aT l bi) 2 ) > (1 - p 2 ) ^ of-Ja. 

i=l i=l 

and 

n n 

^E|a^ + 6^| 3 < J^l^pEl^ + ar 1 ^! 3 < C'M 4 \\a\\l 

i=l i=l 

where we have used the fact a~^bi = 0(1)- By Central Limit Theorem 
arbitrary vector »£l 

n 



2 

1 1 



A.l 



for 



<e)<P(\g>-v\<e)+ C "Ek^fi+Mi!! 



o~ 

where g' has gaussian distribution with zero mean and variance a 2 . The density 
of g' is uniformly bounded by 1/V2na 2 . We have 

( n \ Ce C 

P I ^{atii + Inn) ~v\<e \ < + 



(l_ p 2)l/2 (l- /0 2)3/2 n l/2- 



We can take maximum and conclude the statement. □ 
Remark 3.5. Let us consider the case bi = for all i > 1. 7i is easy s/iow 



vi=l 



3.2. Decomposition of the sphere and invertibility. To prove Theorem 3.1 
we shall partition the unit sphere into the two sets of compressible and 

incompressible vectors, and show the invertibility of A on each set separately. 

Definition 3.6. (Compressible and incompressible vectors) Let 5, r G (0, 1). A 

vector x G W 1 is called sparse if \supp(x)\ < 5n. A vector x G S n is called 
compressible if x is within Euclidian distance r from the set of all sparse vectors. 
A vector x £ S 1 ™ -1 is called incompressible if it is not compressible. The sets 
of sparse, compressible and incompressible vectors will be denoted by Sparse = 
Sparse (5), Comp = Comp (5,t) and Incomp = Incomp(5,r) respectively. 

We first estimate II Ax II for a fixed vector x G S"™ -1 . The next statement can 



be found in 17 



Lemma 3.7. Let A be a matrix from Theorem 3.1 and let K > 1. There 
exist constants 5,t,c G (0, 1) that depend only on K and M 4 and such that the 
following holds. For every u G W 1 , one has 



(3.1) P inf 1 1 Ax - u|| 2 /|M|2 < c 4 Vn, || A| | < 3K^/n < 2e~ 
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Proof. See 17 Statement 4.2]. The proof of this result for matrices which 



satisfy condition (CO) can be carried out by similar arguments. □ 

For the incompressible vectors, we shall reduce the invertibility problem to a 
lower bound on the distance between a random vector and a random hyperplane. 



For this aim we recall Lemma 3.5 from 11 



Lemma 3.8. Let A be a random matrix from theorem. Let A±,...,A n denote 
the column vectors of A, and let H k denote the span of all columns except the 
k-th. Then for every 5,t G (0, 1) and every e > 0, one has 

1 - 

(3.2) P( inf ||Ax|| 2 < en' 1 ) < — ^ F(dist(A k , H k ) < r _1 e). 

x£lncomp(8,T) On 



Lemma 3.8 reduces the invertibility problem to a lower bound on the distance 



between a random vector and a random hyperplane. 

We decompose matrix A = X — zl into the blocks 

'an U TN 



where B is (n — 1) x (n — 1) matrix, U, V G M™^ 1 . 

Let h be any unit vector orthogonal to ^2, ...,A n . It follows that 

= ( h = h 1 V + B T g, 



where h = (hi,g), and 
From definition of h 



g = -h 1 B- T V 



i = pui = i^i 2 + \\ g \\l = \ ni \ 2 + |/n| 2 ||B- T y||| 

Using this equations we estimate distance 

\ ail -(B- T V,U)\ 



dist(Ai, if) > \(A 1} h)\ 



Vi + \\v- T v\\ 2 2 



It is easy to show that ||B|| < ||A||. Let vector e\ G S n ~ 2 be such that 
||B|| = ||Bei||2- Then we can take vector e = (0,ei) T G S 1 " --1 and for this 
vector 

||A|| > ||Ae|| 2 = ||(y T ei,Bei) T || 2 > ||Bei|| 2 = ||B||. 



The bound for right hand sand of (3.2) will follow from the 



Lemma 3.9. Let matrix A be from Theorem 3.1, Then for all e > 

-T 



(3.4) sup] 



l( B ~ V ^~ V l < £ ,\\B\\ < 3KVn) < C^e 1 / 8 + C'(p) n -^, 



where B, U, V are determined by (3.3) andC(p), C\(p) are some constants which 
can depend only on p, K and M4. 
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To get this bound we need several statements. We introduce matrix 

< 3 - 5 > «=(b-' oZ) w =(v 



where O n _i is (n — 1) X (n— 1) matrix with zero entries. Scalar product in (3.4) 
can be rewritten using definition of Q: 

(3.6) suppf IWWW-I \ 

Introduce vectors 

'U'\ „ (u 



cs.7) ir' _ w 

where t7', V are independent copies of U, V respectively. We need the following 
Statement 3.10. 

supP^z (|(QW, WO - t?| < 2e) < Pw, w / (\(QP jc(W - W'),PjW) - u\ < 2e) , 
where u doesn't depend on P jW = (PjU,PjV) t . 

Proof. Let us fix v and denote 

p:=F(\(QW,W)-v\ <2e). 

We can decompose the set [ra] into union [n] = J U J c . We can take Li = 
Pjtf, E7" 2 = P jc[7, Vi = PjV and V 2 = PjcV. By Lemma [A3] 



(3.8) p 2 < P (| (QW, WO - «| < 2e, | (QZ, Z) - v\ < 2e) 

<F(\(QW,W)-(QZ,Z)\<4e). 

Let us rewrite B _r in the block form 



2 1 / E F 



B ~\G H 

We have 

(QW, W) = (EVi, U x ) + (FV 2 , Ux) + (GVx, U 2 ) + (HV 2 , U 2 ) 
+ (E T Ux,Vx) + (G T U 2 , Vx) + (F T Ux, V 2 ) + (U T U 2 , V 2 ) 
(QZ, Z) = (EVi, U x ) + (FV 2 ', Ux) + (GVx, U' 2 ) + (HV 2 \ U' 2 ) 
+ (E T J7i, Vi) + (G T U 2 , Vx) + (F T Ux, V 2 ') + (Fl T U' 2 , v£) 

and 

(3.9) (QW, W) - (QZ, Z) = 2(F(V 2 - V 2 '), Ux) + 2(G T (U 2 - U' 2 ), Vi) 

+ 2(nv 2 ,v 2 )-2(nv 2 \v 2 r ). 

The last two terms in ( |3.9| ) depend only on U 2 ,U 2 ,V 2 , V 2 and we conclude that 

p\ <F(\(QPjc(W-W'),PjW)-u\ <2e), 
where u = u(U 2 ,V 2 ,U 2 \,V 2 \F,G,n). □ 
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Statement 3.11. For all u G W 1 ' 1 

B- T u 



11 



|B- T n| 



G Comp(5,T) and ||B|| < 3Kn 1/2 ^j < 2e~ 



Proof. Let x = B T u. It is easy to see that 
B- T u 



.,, G Comp(5,T) } ^ <3x : ,, ,, 

B " " 2 J I F 2 



G Comp(5, r) and B T :r = u 



Replacing matrix A with B T one can easily check that the proof of Lemma 3.7 
remains valid for B T as well as for A. □ 



Remark 3.12. The Statement 3.11 holds true for B T replaced with B 1 . 



Statement 3.13. Let A satisfies condition (CO) and B be a matrix from de- 
composition (3.3). Assume that ||B|| < 3Ky/n. Then with probability at least 



1 — e cn matrix B has the following properties: 

a) ||B -7 V||2 > C with probability 1 — e~ c ' n in W , 

b) ||B- T y|| 2 < £~ 1/2 ||B- T || H5 with probability 1 — einV, 

c) ||QW|| 2 > e\\B~ T \\ HS with probability 1 - C"(e + n" 1 / 2 ) in W. 

Proof. Let {efc}jj =1 be a standard basis in ~EL n . For all 1 < k < n define vectors 
by 

B-^fc 



iB-^fcl 



By Statement 3.11 vector x^ is incompressible with probability 1 — e cn . We 



fix matrix B with such property. 

a) By norm inequality ||F|| 2 < ||B||||B~ T y|| 2 . We know that ||B|| < 3K^/n. 
By Lemma A. 7 and Lemma A. 9 ||^|| 2 > ^fn. So we have that ||B _1 y|| 2 > C 



i=l 



with probability 1 — e cn . 
b) By definition 

n n 

\\v~ T v\\l = ^(B-^y) 2 = ^HB" 1 ^!! 2 ^,^ 

i=l 

It is easy to see that E(V, Xk) 2 = 1- So 

n 

E\\B- T V\\l = ^2\\B-\ 
i=i 

By Markov inequality 

K- T V\\ 2 > s-^WB^Whs) < e. 



C: 



«II2 



IB 



- 1 1 1 2 



\HS- 
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c) By Lemma |A.3 Lemma A. 4 Lemma A. 6 and Remark 3.5 



P(||QW1| 2 < ellB" 1 !!^) < P(||B- T y|| 2 < sWB^Whs) 

n 

\b- t v\\1 < ^IIB- 1 !!^) = pQT HB-^.ib^,^ 2 < e 2 !^- 1 ! 



2 ^ 

HS) 



i=l 



(J2pi(xi,V) 2 < e 2 ) < 2^2 Pt P((x i ,V) < V2e) < C'ie + n- 1 / 2 ). 



i=l 



i=l 



□ 



Proof, (proof of Lemma 3.9) Let £i, ...,£ n be i.i.d. Bernoulli random variables 
with E& = co/2. We define J ■= {i : & = 0} and E := {\J C \ < c n}. Prom 
large deviation inequality we may conclude that F(E ) > 1 - 2exp(-c 2 ,n/2). 
Introduce event 

E 1 := {4 /2 ^l + ||B-^||| < HB- 1 !!^ < s^WQPAW - W')\\ 2 }, 
where Eq will be choosen later. 

From Statement 13.131 we can conclude that 

Vb,w,w>,j(Ei U \\B\\ > 3K^i) > 1 - C'Oo + n~ 1/2 ) - 2e~ c ' n . 
Consider the random vector 

1 



_ B T P jc {V -V) 

"■" "QPjc(W - W)|| 2 ^B^P^t/ - [/') 



a 



By Statement 3.11 it follows that the event E 2 '■= {a E incomp(5,T)} holds 



with probability 

P B (^2U||B|| > 3K^n\W,W',J) > 1 - 2exp(-c"n). 
Combining these probabilities we have 

Pb,w,W',j{ e o, El, ^2U||B|| >3K^n) 
> i _ 2e - c ° n/2 - C'(e + n~ 1 ' 2 ) - 2e~ c ' n - 2e~ c " n := 1 - p . 
We may fix J that satisfies \ J C \ < cq and 

Wb,W,W'(Ei, E 2 U ||B|| > 3K^n) > 1 - p . 
By Fubini's theorem B has the following property with probability at least 

i - Vm _ _ 

W w ,w'(Ei, E 2 U ||B|| > 3Kv^|B) > 1 - v^o- 
The event {||B|| > 3K^/n} depends only on B. We may conclude that random 
matrix B has the following property with probability at least 1 — ^/po^. either 
||B|| > 3K^/n, or 

(3.10) ||B|| < 3K^i and P w ,W'{Ei, E 2 \B) > 1 - ^/p 

The event we are interested in is 

/ \(QW,W)-u\ 



x/i + IIB-^ll^ 



< 2e 
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We need to estimate probability 

PB,w(fion||B|| < 3KVn) < P B ,w(^on ( |3.10D holds) +P B ,w(^on ( |3.10[ ) fails). 
The last term is bounded by ^Jpo■ 



V( fi on ||B|| < 3K^) < sup F w (n Q \B) + VPo- 

B satisfies <|3.10b 



We can conclude that 

Pb,w(^o n ||B|| < 3K^/n) < sup F W;W ,(n , E^B) + 2^o. 

B satisfies |3.10[ | 



Let us fix B that satisfies (3.10) and denote pi := Piy,VF'(^o ; E\\B). By 



Statement 3.10 and the first inequality in E\ we have 



WW' 



\{QPjc(W-W'),-PjW)-v\ < 



IB 



\HS 



and 



Further 



V 



^W,W'{^l) <Pw,VK'(^l5 ^1) -^2) 



Pi < Pw,w(l K, P J WO " v \ < 2e o 3/2 ^ E 2 ) + ^ 



J 



By definition random vector wq is determined by the random vector ~Pjc(W — 
W), which is independent of the random vector PjW. We fix ~Pjc(W — W) 
and have 



Pi < 



sup 

w =(a,b) T : 
a£lncomp(8 ,r) 

met 



■ PjW {\(w ,PjW)-w\ <e 3/2 e) + ^ 



Let us fix a vector wq and a number We can rewrite 
(3.11) (w , PjW) = Y,( a i x i + 



where ||a||2 + ||^||| = 1- From Lemma A. 4 and Remark A. 5 we know that at 
least [2core] coordinates of vector a £ Incomp(5, r) satisfy 

r . 1 



y2n V<5n 

We denote the set of coordinates of a with this property by spread (a). By 



construction of J we can conclude that | spread(a)| = [cqu]. By Lemma A. 6 



wc 



can reduce our sum (3.11 ) to the set spread(a). Now we will find the properties 
of \bi\. We can decompose the set spread(a) into two sets spread(a) = I\ U I2: 
a) I\ = {i e spread(a) : |&i|v^ — > 00 as n — > 00}; 
c) h = {i E spread(a) : \bi\ = 0(n~ 1/2 )}; 
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From H&H2 < 1 it follows that = o(n). For i 6 I2 we have | a ~ 1 6^ | = O(l). 
By Lemma |A,6| we have 

P(| Yl (aiXi + b iyi )-w\ < 2e~ 3/2 e) < P(| + -w'\ < 2e^ /2 e). 

i£spread(a) 



We can apply Statement 3.4 



r -3/2 

P(| + b lVl ) - w>\ < 2e 3/2 e) < ^_ e ° * + C 2 (l - p 2 )" 3 / 2 ^. 

te/2 ^ ^ ' 

It follows that 

PB,w(fio n ll B ll < < 

(—3/2 \ 

We take eo = s 1 ^ 2 and conclude that 

^B,w(^o n ||B|| < 3K^/n~) < C{p)e 1/S + C'{p)n-^ 8 , 
where C(p), C'(p) are some constants which depend on p, K and M4. □ 



Proof, (proof of Theorem 3.1) The result of the theorem follows from Lem- 
mas [37T1 GTSI and [3T9l □ 



Theorem 



Remark 3.14. It not very difficult to show that we can change matrix zl in 
by arbitrary non-random matrix M with ||M|| < K^/n. We can 
1 . Results of section 



3.1 



> 



3.2 are based on Lemmas 



A. 8 



also assume that Exp- 
and A. 9 which doesn't depend on shifts. It is easy to see that Statement \3.13\ still 
holds true if we assume that e < for some Q > 0. Then we can reformulate 
Theorem 3.1 in the following way: there exist some constants A,B>0 such 
that 

-B 



(s n (X + M) < en- A , ||X + M|| < Ky/n) < C(p)n 



4. Uniform integrability of logarithm 



In this section we prove the next result 

Theorem 4.1. Under the condition (CO) log(-) is uniformly integrable in prob- 
ability with respect to {v n ~}ri>i- 



Before we need several lemmas about the behavior of the singular values 

Lemma 4.2. If condition (CO) holds then there exists constant K := K(p) 
such that P(si(X) > Ky/n) = o(l). 
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Proof. We can decompose matrix X into symmetric and skew-symmetric ma- 
trices: 

2 2 



In 



15 



Theorem 2.3.23] it is proved that for some K\ > \/2(l + p) 



(4.1) P(si(Xi) > K ly /n) = o(l). 



and for some K% > a/2(1 — p) 

(4.2) P(ai(X 2 ) > K 2y /n) = o(l) 



Set if = 2 max(ifi, if 2)- From (4.1), (4.2) and inequality 

si(X)<8i(Xi) + ai(X 2 ) 

it follows that 



(si(X) >Ky/n) <PNsi(Xi 



>^^U<! S l(X2)> 



< P ( Sl ( Xl ) > ^ j + P ( S1 (X 2 ) > ^pj = 

□ 

Remark 4.3. Suppose that elements o/X n depend on n, but satisfy conditions 
(CO) and \xij\ < 5 n y/n, Ei| < 1 and E < b(5 n yfn) l ~ l for some b > 0,1 > 
3 and 5 n — > rai/i i/ie convergence rate slower that any preassigned one as 
n — > 00. Then for some K > it can be shown that 

P(si(X) > Ky/n) = o(n~ l ). 

For the proof see Q Theorem 5. 1 ]. 

Lemma 4.4. If condition (CO) holds then there exist c > and < 7 < 1 
such that a.s. for n»l and n 1_7 < i < n — 1 

s n _j(n _1/,2 X — zl) > c— . 

n 

Proof. Set Si := s^n^X - Up to increasing 7, it is sufficient to prove 
the statement for all 2(n — 1) 1_7 < i < n — 1 for some 7 G (0, 1) to be chosen 
later. We fix some 2(n — l) 1-7 < % < n — 1 and consider the matrix A' formed 
by the first m := n — \i/2] rows of y/nA.. Let s'j > ... > s' m be the singular 
values of A'. We get 

" b n-i — b n-i- 

By R{ we denote the row of A' and Hi = span(i?j,j = l,...,m,j 7^ i). By 
Lemma lA. 101 we obtain 

s'f 2 + ... + s'-_ 2 r . /21 = distr 2 +... + dist;! r . /21 . 

We have 

n-fi/2] n-fi/2] 

(4-3) ±& < \G < £ »r S £ *tj 2 , 

j=n-i j=l 
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where distj := dist (Rj, Hj). To estimate dist(Rj,Hj) we would like to apply 



Lemma A.ll, but we can't do it directly, because Rj and Hj are not inde- 



pendent. Let's consider the case j = 1 only. To estimate distance disti we 
decompose matrix A' into the blocks 



A' 



ai,i Y 
X B 



where X G R m -\Y T £ W 1 ' 1 and B is an m - 1 x n - 1 matrix formed by 
rows B\, ...,B rn ^\. We denote by H[ = span(2?i, ...,5 m _i). From definition of 
distance 



distCRi.ifi) = inf ||22i-v|| 2 > inf \\Y - u\\ 2 = dist(y, H[) 



and 



6im(H[) < dim(Hi) < n-l-i/2 < n - 1 - (n - 1 



,!-7 



Now vector Y and hyperplane H[ are independent. Fixing realization of H[, 
by Lemma A.ll, with n,R,H replaced with n — 1,Y,H[ respectively, we can 
obtain that 

1 



P(dist(y,iJ() < -yjn - 1 - dim(#()) < exp(-(n - if). 
Using this inequality it is easy to show that 



/ n-l n-\i/2\ ( 

(J U U | distto, 

\n>lj=|-2(n-l) 1 -T] j=l I 



2 V 2 



< oo. 



Now by Borel-Cantelli lemma and (4.3) we can conclude the statement of the 
lemma. □ 



Remark 4.5. Lemma 
l + o(l). 



4-4 holds true if we assume that E Xu 7^ and EX 



Proof. (Proof of Theorem 4.1) To prove Theorem 4.1 we need to show that 
there exist p, q > such that 



(4.4) 

and 

(4.5) 



lim lim ] 

t— »oc n— >oo 



lim lim ] 

t— ¥oo n— >oo 



X P V n (dx) > t = 



x~ q v n (dx) > t = 0. 



By Lemma 4.2 there exists set fio := ^o,n = € : si(X) < Kn 1 / 2 } such 
that 



(4.6) 



P(O ) = 1 - o(l). 



We conclude (4.4) from (4.6) for p = 2. 
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We denote := f2i jra = {u £ Q : s n _j > c^n 1 7 < i < n — 1}. Let us consider 
the set f^2 := ^2,n = Hi fl {w : s„ > n^ B ~ 1 ^ 2 }, where B > 0. We decompose 
probability from (4.5) into two terms 



x- q u n {dx) >tj =Il+I 2 



where 



Ii := 



h 



x q u n (dx) > t, Q 



/ x~ q v n (dx) > t, ^2 

Jo 



We can estimate I2 by 

I 2 < P(s„(X - Vn^I) < n~ A , fi„) + P(J2§) + P(«£). 
From Theorem 13. II it follows that 

(4.7) P(s„(X - Vnzl) < n~ B , O ) < C(p)n" 1/8 . 



By Lemma 4.4 
(4.8) 



lim P(0£) = 0. 



From (4.6), (4.7) and (4.8) we conclude 



lim I 2 = 0. 

n— >oo 



To prove (4.5) it remains to bound 1%. From Markov inequality 

f 00 

x~ q v n (dx)l(n 2 ) . 



Ii < - E 



t 



By definition of Q2 



E 



x- q v n (dx) 1(0 2 ) 



n— [n 1 7 ] 



-7* + 



n 



i=l 



i=n- fni—T]+i 



□ 



1 E 

n 

i=n— \n 1 

1 n fl 

If < (7 < min(l,7/(-B + 1/2)) then the last integral is finite. 

5. Convergence of singular values 



Let function J- n (x,z) be an empirical distribution function of singular values 
si > ••• > s n of matrix n _1 / 2 X — zl which corresponds to measure u n (z, •). 

Let us recall definition of Stieltjes transform 

Definition 5.1. The Stieltjes transform of measure m(-) on M. is 

m(dx) 



5(a) 



a S 



x — a 



18 



A. NAUMOV 



In this section we prove the following theorem 

Theorem 5.2. Assume that condition (CO) holds true. There exists non- 
random distribution function F(x, z) such that for all continues and bounded 
functions f(x), a. a. z G C and all e > 



f(x)dF n (x,z)- / f(x)dF(x,z) 



> e I — > as n — > oo, 



Proof. First we show that family {F(z, x)} n >i is tight. From strong law of 
large numbers it follows that 



/•oo y n 

/ x 2 dF(x, z) < — 2 X?j — >• 1 as n — > 
Jo n i,j=i 



oo. 



Using this and the fact that Sj(n -1 / 2 X — zl) < Sj(n -1 / 2 X) + \z\ we conclude 
tightness of {F n (z, x)} n >i. If we show that F n weakly converges in probability 
to some function F, then F will be distribution function. 



Introduce the following 2n x 2n matrices 



(5.1) 



V 



J(z) 



O n Zl 

where O n denotes n x n matrix with zero entries. Consider matrix 

V(z) := V- 3(z). 

It is known that eigenvalues of V(z) are singular values of re _1 ' 2 X — zl with 
signs db. 

It is easy to see that empirical distribution function F n (x,z) of eigenvalues of 
matrix V(z) can be written in the following way 



F n (x, z) = — V < x} + — V < x}. 

2n 2n 
i=l i=l 

There is one to one correspondence between F n (x, z) and F n (x, z) 

1 + sgn(x)F n {\x\, z) 

Fn{X,z) = 

So it is enough to show that there exists non-random distribution function 
F(x, z) such that for all continues and bounded functions f(x), and a. a. z G C 



(5.2) 



f(x)dF n (x,z) 



f(x)dF(x,z) 



> e ) — > as n — > oo. 



We denote Stieltjes transforms of F n and F by S n (x,z) and S(x,z) respec- 
tively. Due to the relations between distribution functions and Stieltjes trans- 



forms, (5.2) will follow from 

(5.3) P(\S n (a, z) — S(a, z)\ > e) — > as n — > oo, 

for a.a. z G C and all a G C + . 
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Set 

(5.4) K( a ,z):=(V(z)-aI 2n )- 1 . 

By definition S n (a, z) = Tr R(a, 2). We introduce the following function 



. 2n 

s„(q,z) :=ES n (a,z) = — V]e[R(q, 



Z)\ii, 



i=l 



One can show that 

1 n ( 

s n (a,z) = -^E[R(a,z)]ii = - E[R(a,z)]i 



2h 



i=l 



77 



i=n+l 



By Chebyshev inequality and Lemma A. 12 it is staighforward to check that 
(5.5) \s n (a, z) — s(a, z)\ — > as n — > oo. 



implies (5.3). 



By resolvent equality we may write 



1 



1 + as n (a, z) = — E TrfVRfa, z)) — zt n (a, z) — zu n (a, z) 
2n 



Introduce the notation 



and represent A as follows 



A := — ETr(VR) 

2?7< 



A = ^Ai + ^A 2 , 



where 



-i n i n 

Ai = - V E[VR]ii, A 2 = - V E[VR" 
n z — ' n 



i+n,i+n ■ 



i=l 



1=1 



First we consider Ai. By definition of the matrix V, we have 



1 

Al = ^3/2 Yl EX jkRk+n,j- 



Note that 



dX jk yjn 
Applying Lemma A. 14 we obtain 

Ai = Bi + JB 2 + JB 3 + JB 4 + r n (a, z). 
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1 n 

j,k=l 
1 ™ 

"2 E ^[-^'[ e fe+™ e J]-'^]fc+nJ 



n- 



j,fc=i 



£ E[R[e fe eJ +n ]R] fc+fM 



n 



k+n,j 



j,k=l 



1 ™ 

^ E E (- R fc+«,i) 2 
i,fc=i 

1 n 

"2 5^ ^ RjjRk+n,k+r 



n 



n- 



j,k=l 



E Rk+n t kRj+n,j 



j,k=l 
n 



^] E RkjRk+n,j+r. 



j,k=l 



Without loss of generality we can assume further that E Xj^ = 1 because the 
impact of diagonal is of order 0(n _1 ). 

From IIRH//5 < -^/nHRH < ^Jnv~ l it follows 



1 n 1 

l| < -J Yj EX ]knRk+n,j) 2 < — 



j,k=i 



Similarly 



< 



v 2 n 



By Lemma A. 12 I>2 = — s„(a, z) + e(a, z). By Lemma A. 13 B3 = —pt^(a, z) + 



e(a, z). We obtain that 



A i = -«n( a > 21 ) - ptn(ot, z) + <5 n (a, z). 



Now we consider the term A2. By definition of the matrix V, we have 



A 9 



1 n 

Tn / , E X jk R j:k+n . 



n 3/2 L-j 
j,k=l 



By Lemma A. 14 we obtain that 



(5.6) 



A 2 = Ci + C 2 + C 3 + C 4 + r n {a, z). 
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where 



^ n 1 n 

Cl = 2 ^^■\- e 3 e k+n\R\j,k+n = ^ ^2 ^ RjjRk+n,k+n 

j,k=l j,k=l 

^71 1 71 

C 2 = — 2 2 E[R[efc+neJ]R]j,fc+„ = ^ E(i^ fe+n ) 2 



22- 



^ E[R[e fc eJ +n ]R]j 5 fc +n — — — ^ ^ E Rj k Rj +Utk+n 



j,k=i 



j,k=i 



n- 



C4 — 2 ^[-^•[ e i+™ e fc]-'^]i,fc+™ 

It is easy to show that 

ic 2 i < ic 3 i < 4 



,k+n- 



j,k=l 



-pu 2 n (a,z) + 



By Lemma A. 12 Ci = —s^(a, z) + e n (a, z). By Lemma A. 13 
e n (a,z). We obtain that 

^2 = -sl,(a, z) - pu^{a, z) + S n (a, z). 

So we have that 

A = -sl(a, z) - ^t 2 n {a, z) - |*4(a, z) + e n (a, z). 



No we will investigate the term zt n (a, z) which we may represent as follows 

Y n \ n 

at n (a,z) = -^E[V(z)R] 3 - +n j = - ^E[VR] j+n>i - zs n {a, z). 

U 3=1 U 3=1 

By definition of the matrix V, we have 

1 - 

at n (a,z) = EX jk R j:k -zs n (a,z) = 

n j,k=l 

Di + D 2 + D 3 + B 4 - zs n (a, z) + r n (a, z), 

Y n 1 n 

~2 ^ E[R[eje^ +n ]R] iife = ^ ER jtj R k+n>k 

j,k=l 3,k=l 
^ n _. n 

-2 ^ E[R[e fc+n eJ]R] i)fe = ^ ER jjk+n R j>k 



where 



72" 



72- 



72" 



£ E[R[e fe eJ +n ]R] 



3,k 



3,k=l 
n 



72" 



y~] E Rj ik Rj +rijk 



3,k=l 
n 



E[R[ ej - +n e£]R] 



3,k 



3,k=l 



^ Rj,j+nRk. 



k- 



3,k=l 
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By similar arguments as before we can prove that 



»2 < 



1 , 1 

< 



v 2 n 



3—9 



and Di = -s n (a, z)t n (a, z) + e n (a, z), D4 
obtain that 



-ps n (a, z)u n (a, z) + e n (a, z). We 
at n (a, z) = -s n (a, z)t n (a, z) - ps n (a, z)u n (a, z) - zs n (a, z) + 8 n (a, z). 



Similar we can prove that 

au n (a, z) = -s n (a, z)u n (a, z) - ps n (a, z)t n (a, z) - zs n (a, z) + S n (a, z). 

So we have the system of equations 

(5.7) 1 + as n (a, z) + s n (a, z) = 

= -|*n( a > z ) ~ i^n{oL, z) - ^ul(a, z) - ^u n (a, z) + 5 n (a, z) 

(5.8) at n (a, z) = 

= -s n (a, z)t n (a, z) - ps n (a, z)u n (a, z) - zs n (a, z) + 5 n (a, z) 

(5.9) au n (a, z) = 

= -s n (a, z)u n (a, z) - ps n (a, z)t n (a, z) - zs n (a, z) + 5 n (a, z). 



It follows from (5.8) and (5.9) that 

(a + s n )(zt n + pt 2 n ) = -s n (zpu n + zpt) - p 2 s n t n u n - \z\ 2 s n + S n (a, z) 
(a + s n )(zu n + pul) = -s n (zpu n + zpt) - p 2 s n t n u n - \z\ 2 s n + 5 n (a, z). 



So, we can rewrite (5.7) 

(5.10) 1 + as n (a, z) + s^(a, z) + p 2 t 2 {a, z) + zt n (a, z) = 5 n (a, z). 



From equations (5.8) and ( |5.9[ ) we can write equation for t n 

\P\ 2 SI 



(5.11) 



We denote 



a + s n 



a + s n 



A = a + s r 



a + s n 



zs n + 5 n (a,z) 



a + s n 



After simple calculations we will have 
(a + s n )(zt n + pt 2 n ) = 

2p 2 \z\ 2 s 2 n z 2 ps r , 



z 2 ps r 



n \(a + s n )A A 

|2 



A 



\pV*r. 



pzs r 



ZS r 



a + s)A A J \(a + s)A A 



pzs r 



ZSr 



\z\ 2 s n + 5 n (a, z). 
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Figure 4. Histogram of eigenvalues of matrix V for n = 1000. 
entries are Gaussian random variables. On the left p = (Cir- 
cular law case). On the right p = 0.5 (Elliptic law case). 

We denote y n := s n and w n := a + (pt^ + zt n )/y n . We can rewrite equa- 
tions (pT7l), and dsT9b 



(5.12) 1 + w n y n + yl = 5 n (a,z) 
(5.13) 
(5.14) 



a + 



pt 2 n + zt n 

Vn 



(a + s„)(2:i n + pt 2 n ) 
(a + y n )A 

pzyl 



z 2 py n _ z 2 py n 
A A 



\z?Vr> 



|p|V. 



zy r , 



(a + y n )A A J \(a + y n )A 



zy n 



+ 5 n (a,z). 



Remark 5.3. If p = i/ien we can rewrite (5.12), (5.13), and (5.14) 
1 + w n y n + y 2 n = S n (a,z) 



a + 



zt n 

Vn 



(w n - a) + (w n - a) 2 y n - \z\ 2 s n = 5 n (a, z). 
This equations determine the Circular law, see Jw]. 



We can see that the first equation (5.12) doesn't depend on p. So the first 



equation will be the same for all models of random matrices described in the 
introduction. On the Figure [4] we draw the distribution of eigenvalues of matrix 
V for p = (Circular law case) and p = 0.5 (Elliptic law case). 

Now we prove convergence of s n to some limit sq. Let a = u + iv,v > 0. 
Using (5.10) we write 

Cv(Sn %) — (Sn Sm)(Sn S<m) P ipn ^m)(^n ~\~ tfri) z{t m tm) ~\~ ^n,m- 
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By triangle inequality and the fact that \s n \ < v 1 



(5.15) 



Sim. 



21 s n 



p \t n t m 1 1 t n + t m | | z 1 1 t r 



+ 



From (5.11) it follows that 

((a + s n ) 2 - p 2 s 2 n )t n = pzs 2 n - zas n - zs 2 n + e n . 
We denote A n := ((a + s n ) 2 — p 2 s 2 l ). By triangle inequality 
(5.16) |A m ||t n t m \ < |t m ||A n A m | 

2|p| \s n s m \ -\- c 2\z \\s n s Tl 



+ 



+ \z \\a \\s r 



We can find lower bound for |A m |: 

(5.17) |A m | = \a + (1 - p)s m \\a + (1 + /o)s m | 

> Im(a + (1 - p)s m ) Im(a + (1 + p)s m ) > v 2 , 

where we have used the fact that Ims m > 0. From definition of A n it is easy 
to see that 



(5.18) 



|A n - A m | < 2|a||s n 



+ 



2(1 + p 2 )\ Sn - S r 



We can take \u\ < C, then \a\ < v + C. From ( |5.15[ ),( |5.16[ ),( |5.17D and (|5_18j) it 
follows that there exists constant C , which depends on p,C,z, such that 

i i ^ i ii// \ i 

We can find vq such that 



< 1 for all v > uq. 



Since e' ra m (a, z) converges to zero uniformly for all v > t>o, \u\ < C and s n , s m are 
locally bounded analytic functions in the upper half-plane we may conclude by 
Montel's Theorem (see (1J Theorem 2.9]) that there exists an analytic function 
so in the upper half-plane such that lims n = sq. Since s n are Nevanlinna 
functions, (that is analytic functions mapping the upper half-plane into itself) 
So will be a Nevanlinna function too and there exists non-random distribution 
function F(z, x) such that 

dF(z,x) 



s (a) 



x — a 



The function sq satisfies the equations (5.12), (5.13), and (5.14). 



□ 
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Theorem A.l. ( Central Limit Theorem) Let Zx,...,Z n be independent random 
variables with EZj = and finite third moment, and let a 2 = X]£=i ^ |^i| 2 - 
Consider a standard normal variable g. The for every t > 0: 



v 1=1 / 



(g < t) 



< Co-- 3 ^2e\Z, 



3 

ll ' 



i=l 



where C is an absolute constant. 



Lemma A. 2. Let event E(X,Y) depends on independent random vectors X 
and Y then 

F(E{X,Y)) < (F(E(X,Y),E(X,Y')) 1 / 2 , 
where Y' is an independent copy ofY. 



Proof. See in [H]. 



□ 



Lemma A. 3. Let Z\, Z n be a sequence of random variables and pi, ...,p n be 
non-negative real numbers such that 



i=l 



then for every e > 



{J^PiZi <e)< 2j2 Pi F(Z i < 2e). 



i=i 



i=l 



□ 

Lemma A. 4. If x G Incomp(5, r) then at least ^5r 2 n coordinates of x 

t . 1 

< \Xk\ < 



Proof. See in [17] . 

Lemm 

satisfy 



V2n V on 

Remark A. 5. We can fix some constant cq such that 

\5r 2 <c,<\. 

Then for every vector x G Incomp(5,T) \ spread(x)| = [2con]. 



Proof. See in 

Lemma A. 6. Let Sj = w ^ere J C [n], and I C J then 



□ 



supPflSj - v\ < e) < supP(|5/ - v\ < e). 
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Proof. Let us fix arbitrary v. From independence of £j we conclude 

n\Sj - v\ < e) < EP(|5j + Sjn - v\ < e\{^} ia ) < supP(|S/ - u\ < e). 



□ 



Lemma A. 7. Let Z be a random variable with E Z 2 > 1 and with finite fourth 
moment, and put M\ := E(Z — EZ) 4 . Then for every e E (0, 1) t/iere exists 
p = p(Mi, e) suc/i i/tot 

supP(|Z-v| < e) <p. 



Proof See in (IT]. □ 

Lemma A. 8. Let £i, ...,£ n 6e independent random variables with E£? > 1 and 
E(^ — E£) 4 < M^ 1 , where M4 is some finite number. Then for every e S (0, 1) 
there exists p = p(M^ e) E (0, 1)) smc/j i/iai i/ie following holds: for every vector 
x = (xi, ...,x n ) E 5 n_1 ; the sum S = Y17=l x k^k satisfies 

supP(|S"-t;| < e) <p. 

veM. 

Proof. See in □ 

Lemma A. 9. Let X = (X±, ...,X n ) be a random vector in W l with independent 
coordinates X^. 

1. Suppose there exists numbers £q > and L > such that 

supP(|Xfc — v I < e) < Le for all e > Eq and all k. 

Then 

sup P(||X - v|| 2 < sy/n) < (CLe) n for all e > e , 

!)6l" 

where C is an absolute constant. 

2. Suppose there exists numbers e > and p E (0, 1) such that 

supP{\X k -v\ < e) < Le for all k. 

Then there exists numbers e\ = £\{e,p) > and p\ = p\(e,p) E (0, 1) such that 
sup P(||X--i;|| 2 < eiy/n) < (pi) n . 

Proof. See |17 [ Lemma 3.4]. □ 

Lemma A. 10. Let 1 < m < n. If A has full rank, with rows Ri,...,R m and 

H = sp&n(Rj,j ^ i), then 



1=1 8=1 



Proof. See |16| Lemma A. 4]. 



□ 
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Lemma A. 11. There exist 7 > and 5 > such that for all n 3> 1 and 

1 < i < n, any deterministic vector v G C and any subspace H of C n with 
1 < dim(.ff) < n — n 1-7 , we have, denoting R := {X\, ...,X n ) + v, 



P(dist(i?, H) < ^n- dim(H)) < exp(- 



-n 



Proof. See [16j Statement 5.1]. 

Lemma A. 12. Under the condition (CO) for a = u + iv,v>0 

C 



E 



1 n (\ n \ 

- V Ra(a, z) - E - V i^(a, z) 
n \ n / 

i=l \ i=l / 



< 



nv 



2 ' 



□ 



Proof. To prove this lemma we will use Girko's method. Let X^' be a matrix 
X with j-th row and column removed. Define matrices Vw and V"'(z) as 
in (5.1) and RW by (5.4). It is easy to see that 



rk(V(z) - V^(z)) = rk(V - V^) < 4. 



Then 



(A.l) -I Tr(V(z) - air 1 - Tr(V (i) 0) - al) _1 | < 
n 



rk(V(z) - V^(z)) < 4 



7l!> 



We introduce the family of cr-algebras Ti = a{Xj t k, j, k > i} and conditional 
mathematical expectation Ej = E(-|J r j) with respect to this cr-algebras. We can 
write 

n n 

— TrR — - E Tr R = - V Ej Tr R - Ei_i Tr R = V 7i . 



1=1 



i=l 



The sequence ( 7 i,.7 r i)j>i is a martingale difference. By (A.l) 
(A.2) Ya\ = -|Ei(TrR-TrR w ) -Ei_i(TrR- TrR (i) )| < 



n 



(A.3) 



< |Ei(TrR- TrR w )| + | E 4 _i(Tr R - Tr R w )| < 



C 



vn 



From Burkholder inequality for martingale difference (see [13 



E 



i=i 



<iT 2 E (j^| 7i 



vi=l 



and (|A.2) it follows 
1 n 

E - VJ2«(a,z)-E 



1=1 



-^i2«(a,2) J 
> i=i / 



< A- 2 E(^| 7i | 2 ) < K 2 



C 



i=l 



nv 



2 ' 



□ 
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Lemma A. 13. Under the condition (CO) for a = u + iv,v>0 

2 



E 



1 n (l n \ 

- Ri ;i+n (a, z) - E 1 - y j Ri )i+n (a, z) 

n 1=1 \ n 8=1 / 



< 



c 



nv 



4 ' 



Proof. As in Lemma A. 12 we introduce matrices V^' and RW. We have 



V = + ej eJV + Ve 3 -eJ + e i+n eJ +n V + Ve j+n ej +n 
By resolvent equality R - Rtf) = -RW(V(^) - V^\z))H 



1 n 



k+n ^k,k+ 



U) 



k=l 



1 

= " X][ R0) ( e i e J V + e i+" e J+n V + VejeJ + Ve j+n ej +n )K] k>k+n = 

71 k=l 

= Ti + T 2 +T 3 + T 4 . 
Let us consider the first term. The arguments for other terms are similar. 

n 2n 

£|H< J '>e i eJVR] fc , fc+n = TrR^eJVRE = ^ REli ,, e 3 ejV] jU 



k=l 

where 



E 



I O r 

From maxdlR^H, ||R||) < v^ 1 and Holder inequality it follows that 

2 



E 



£fR0 ei eJVJR] fc: 



fc+n 



fc=l 



< 



c 



By similar arguments as in Lemma A. 12 we can conclude the statement of the 
Lemma. □ 

Lemma A. 14. Under the condition (CO) for a = u + iv,v>0 

1 n 



n 



j,k=l 
1 - 

j,k=i 



<9R 



<9X 



dR 



dX, 



+ r n (a,z), 



k+n,j 



where 



\r n (a,z)\ < — £^ 



Proof. By Taylor's formula 

(A.4) E Xf(X, Y) = /(0, 0) E X + f' x (0, 0) E X 2 + /£(0, 0) E AY+ 

+ E(l - 0) [X 3 f^(9X, 0Y) + 2X 2 Yf'(0X, 9Y) + IF 2 /!'^!, 0Y)] 
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and 



(A.5) Ef' x (X,Y) = £(0,0) +E(1 - 0)[Xf^(0X,0Y) + Yf^ y (0X,0Y)] 
E f y {X, Y) = f y (0, 0) + E(l - 6) [Xf^(0X, 6Y) + Yf» y (0X, 9Y)], 
where 9 has uniform distribution on [0, 1]. From ( |A.4 ) and (A.5) for j ^ k 



E XjkRk+n,j — E 
(|Ajfc| 3 + \Xj k \) 



5R " 




- pE 


OR " 




dXjk_ 


k+n,j 


dX kj _ 


k+n,j 



< 



<9 2 R 

Qg2~{9X jk ,6X kj ] 

jk 



J k+n,j 



+ 



{\X k j\ 2 \Xj k \ + \X k j\ 



d 2 K 

ox* kj 



(%\Xj k \ \X k j\ + \Xj k \ + |-X"fcj| 



(0Xj k , 9X k j) 



d 2 n 



k+n,j 



+ 



dx 4k ax, 



jk<J^kj 



(0Xj k , 0X k j) 



k+n,j 



Let us consider the first term in the sum. The bounds for the second and third 
terms can be obtained by similar arguments. We have 

d 2 K 1. 



where 



7? 



^■i e j e n+k + e n+k e j )^-{ e j e n+k + e n+k e j )R 



1 



r 3 
1?4 



?? 

— Reje n+fc Re n+/ fce 7 - R 

— Re n+ fce 7 - Rej-e„i fcR 
n 

- Re n +fc eJ~Re n+k e JR. 

Tt 



From |Rjj| < t> 1 it follows that 



1 " 

^72 _£ E i*i*HP<Wwi< 



i,fe=i 

for a = 1, 3 and i = 1, 4. For j = k 



mr 



n 2 5Z E 



3=1 



C 



So we can add this term to the sum 



11- 



5R 



□ 
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